Enable autodiff in ci for all major os by ZuseZ4 · Pull Request #152768 · rust-lang/rust

ZuseZ4 · 2026-02-17T20:25:34Z

Follow-up attempt to #140064 after moving autodiff to dlopen.
It covers Linux (x86_64+aarch64), MacOS (aarch64), Windows (mingw-llvm aarch64+x86_64)
The extra build time for Enzyme are 180.27s on our slowest runner (aarch64-apple).

The follow-up distribution via rustup probably still needs a small fix, see #151063 (comment)

Placing the downloaded libEnzyme artifact on my local linux under ~/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib enables my nightly compiler to run autodiff.

r? @Kobzol

closes: #140064
closes: #151243
closes: #151063

rustbot · 2026-02-17T20:25:40Z

Kobzol is not on the review rotation at the moment.
They may take a while to respond.

ZuseZ4 · 2026-02-17T20:26:57Z

@bors try jobs=dist-aarch64-apple

Enable autodiff in ci for all major os try-job: dist-aarch64-apple

rust-bors · 2026-02-17T22:53:16Z

☀️ Try build successful (CI)
Build commit: f1988f0 (f1988f049b5de890c7b71b3da66d38620ed38fbd, parent: dfbfbf785f46d10103e80735a9ccb4765bd6dfe2)

ZuseZ4 · 2026-02-17T22:56:53Z

@bors try jobs=dist-x86_64-linux

Enable autodiff in ci for all major os try-job: dist-x86_64-linux

rust-bors · 2026-02-18T02:59:56Z

☀️ Try build successful (CI)
Build commit: 20e4cfa (20e4cfae177c9daec1a6b5ae5d1332821335dcbc, parent: 8387095803f21a256a9a772ac1f9b41ed4d5aa0a)

ZuseZ4 · 2026-02-18T03:58:15Z

@bors try jobs=dist-aarch64-linux

Enable autodiff in ci for all major os try-job: dist-aarch64-linux

rust-bors · 2026-02-18T07:29:11Z

☀️ Try build successful (CI)
Build commit: 22ac1fb (22ac1fb63228652dc40e63504ab188e2bae982bb, parent: 8387095803f21a256a9a772ac1f9b41ed4d5aa0a)

ZuseZ4 · 2026-02-18T08:59:01Z

@bors try jobs=dist-aarch64-llvm-mingw

Enable autodiff in ci for all major os try-job: dist-aarch64-llvm-mingw

rust-bors · 2026-02-18T09:10:18Z

💔 Test for ea4964d failed: CI. Failed job:

try - dist-aarch64-llvm-mingw (web logs, enhanced plaintext logs)

ZuseZ4 · 2026-02-20T21:15:35Z

I guess we could extract some shared logic that makes sense for both LLVM and LLD into a separate function and use it both in configure_llvm and in the LLD build step.

That's already shared between llvm and lld. Enzyme ignores these LLVM_ variables, so we instead have to use -fuse-ld=lld, which in turn isn't needed for the LLVM/LLD build steps.

I don't think we can nicely share it between all three, llvm+lld+enzyme.

I tried all 5 targets and they build fine.

Kobzol · 2026-02-23T09:26:24Z

Thanks, the LLD logic looks reasonable, as far as bootstrap workarounds go.

@bors r+

rust-bors · 2026-02-23T09:26:27Z

📌 Commit c033de9 has been approved by Kobzol

It is now in the queue for this repository.

@Kobzol

…r=Kobzol Enable autodiff in ci for all major os *[View all comments](https://triagebot.infra.rust-lang.org/gh-comments/rust-lang/rust/pull/152768)* Follow-up attempt to rust-lang#140064 after moving autodiff to dlopen. It covers Linux (x86_64+aarch64), MacOS (aarch64), Windows (mingw-llvm aarch64+x86_64) The extra build time for Enzyme are 180.27s on our slowest runner (aarch64-apple). The follow-up distribution via rustup probably still needs a small fix, see rust-lang#151063 (comment) Placing the downloaded libEnzyme artifact on my local linux under `~/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib` enables my nightly compiler to run autodiff. r? @Kobzol closes: rust-lang#140064 closes: rust-lang#151243 closes: rust-lang#151063

Rollup of 6 pull requests Successful merges: - #153007 (`rust-analyzer` subtree update) - #152768 (Enable autodiff in ci for all major os) - #152003 (Reflection TypeId::trait_info_of) - #152988 (Port `#[register_tool]` to the new attribute system) - #152989 (Port `#[rustc_inherit_overflow_checks]` to the new attribute parsers) - #152991 (fix interpreter tracing output)

…uwer Rollup of 14 pull requests Successful merges: - #153007 (`rust-analyzer` subtree update) - #152670 (Simplify ThinLTO handling) - #152768 (Enable autodiff in ci for all major os) - #152908 (Enable rust.remap-debuginfo in the dist profile) - #152999 (Check importing `crate`/`$crate`/`super` after handling `self`) - #152003 (Reflection TypeId::trait_info_of) - #152976 (Revert relative paths for std links in rustc-docs) - #152985 (Port `#[feature]` to the new attribute system) - #152989 (Port `#[rustc_inherit_overflow_checks]` to the new attribute parsers) - #152991 (fix interpreter tracing output) - #153004 (Superficial tweaks to the query modifier docs in `rustc_middle::query::modifiers`) - #153008 (bootstrap.compiler.toml: update name of primary branch) - #153016 (Migration of `LintDiagnostic` - part 2) - #153020 (rustdoc: Improve sentence for documented empty impl blocks) Failed merges: - #152988 (Port `#[register_tool]` to the new attribute system)

@Kobzol

Rollup merge of #152768 - ZuseZ4:autodiff-in-ci-for-all-os, r=Kobzol Enable autodiff in ci for all major os *[View all comments](https://triagebot.infra.rust-lang.org/gh-comments/rust-lang/rust/pull/152768)* Follow-up attempt to #140064 after moving autodiff to dlopen. It covers Linux (x86_64+aarch64), MacOS (aarch64), Windows (mingw-llvm aarch64+x86_64) The extra build time for Enzyme are 180.27s on our slowest runner (aarch64-apple). The follow-up distribution via rustup probably still needs a small fix, see #151063 (comment) Placing the downloaded libEnzyme artifact on my local linux under `~/.rustup/toolchains/nightly-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib` enables my nightly compiler to run autodiff. r? @Kobzol closes: #140064 closes: #151243 closes: #151063

RalfJung · 2026-02-25T08:16:45Z

src/ci/github-actions/jobs.yml

        --enable-sanitizers
        --enable-profiler
        --set rust.jemalloc
+        --set llvm.link-shared=true


This is a highly non-trivial change with a risk of all sorts of unexpected side-effects. It's odd that this isn't even mentioned in the PR description, and it definitely should only have landed in a rollup=never PR to facilitate bisecting. I think this is the cause for #153077 but this PR became part of a gigantic rollup so I am not sure.

I agree that this shouldn't be done for several reasons, including also performance.

At the very least, it should only be done when building enzyme (e.g. in a separate build step).

At the very least, it should only be done when building enzyme (e.g. in a separate build step).

Enzyme needs to be linked against the same LLVM as rustc given that it is an LLVM plugin, yet we we don't want to statically link it into rustc, such that we can put it in a separate rustup component that isn't installed by default.

…all-os, r=Kobzol" This reverts commit 1d21fd3, reversing changes made to 1894a0e.

Revert "Enable autodiff in ci for all major os" Reverts rust-lang#152768 which fixes rust-lang#153077.

RalfJung · 2026-02-25T12:53:26Z

I am more and more confused about what this PR even does. "enable in CI" sounds like it would enable tests for autodiff to be checked in CI. But instead it seems what it does is enabling autodiff for the distributed artifacts (only on nightly, I assume)?

Revert "Enable autodiff in ci for all major os" Reverts c033de9 (part of rust-lang#152768) in order to fix rust-lang#153077.

Revert "Move aarch64-apple dist builder to dynamic llvm linking" Reverts c033de9 (part of rust-lang#152768) in order to fix rust-lang#153077.

Revert "Move aarch64-apple dist builder to dynamic llvm linking" Reverts c033de9 (part of #152768) in order to fix #153077.

Revert "Move aarch64-apple dist builder to dynamic llvm linking" Reverts c033de9 (part of rust-lang#152768) in order to fix rust-lang#153077.

Rollup merge of #153079 - RalfJung:revert-macos-dyn, r=jieyouxu Revert "Move aarch64-apple dist builder to dynamic llvm linking" Reverts c033de9 (part of #152768) in order to fix #153077.

rustbot assigned Kobzol Feb 17, 2026

ZuseZ4 changed the title ~~Autodiff in ci for all os~~ Enable autodiff in ci for all major os Feb 17, 2026